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CROSS-REFERENCE TO RELATED APPLICATIONS 

This application is related to U.S. Application Serial No. entitled 

METHOD AND APPARATUS FOR IMPLEMENTING A USER INTERFACE USING 

i! 

1 1 OCCLUSION GLYPH CODE TILINGS (Attorney Docket No. 07447.0007-00000), 

!i 

P filed December 18,2000. 

|i BACKGROUND OF THE INVENTION 

\ The present invention relates to glyph codes, and in particular to glyph codes 

i 

il having occluded regions. 

i; 

!i Codes can be embedded in an image on a substrate using machine-readable 

I ! 

i ! 

10 i I marks, such as glyph marks used in Xerox DATAGLYPH codes. The machine-readable 

I I marks can be captured in an image, and the image analyzed to extract information from 
iithe codes embedded in the image. Glyph marks in particular have several advantages. 

For example, glyph codes can be decoded from glyph marks even when the image 
1 1 carrying the glyph marks is distorted or there is some type of noise in the glyph marks. 
15 j! Another advantage of glyph marks is that they may have an unobtrusive visual 

appearance. If the glyph marks are sufficiently small, the glyphs appear as grayscale to 
the unaided eye. For example, logically-ordered, single-bit digital quanta may be 
encoded by respective elongated slash-like glyphs tilted to the left and right of vertical by 
ji approximately +45° and -45° for encoding logical "Os" and "Is," respectively. The 
20 ; mutual orthogonality of the glyphs for the two logical states of 0 and 1 of these single bit 

!i 

I i digital quanta enhances the discriminabihty of the code. Thus, the code pattern 
embedded in the glyphs can be recovered from an image of the glyphs, even when the 
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code pattern is written on a fine grain pattern to cause the code pattern to have a 
generally uniform grayscale appearance. 

Decoding machine-readable marks, such as glyphs, in a substrate image requires 
an image capture window sized large enough to capture a sufficiently large set of glyphs 
fi*om which the code pattern embedded therein can be decoded. If the capture area is too 
small, there will not be a sufficiently large set of glyph codes from which the embedded 
code pattern can be decoded. Therefore, the required size and shape of the image capture 
window will vary depending on the particular code pattem embedded in the glyphs and 
the characteristics of the glyphs, such as size, shape, and orientation. For periodic tiled 
glyph patterns, an image capture window encompassing a tile provides an image area of 
glyphs that can be used for glyph decoding. If the capture window is shifted from 
alignment with a tile in a periodic tiled code pattem, the tile can still be reconstructed 
from the captured parts. See, for example, U.S. Patent No. 6,000,621 to Hecht, et al, 
entitled Tilings of Mono-Code and Dual-Code Embedded Data Pattem Strips For Robust 
Asynchronous Capture, which teaches facilitating recovery of data through use of an 
appropriately-sized capture window, and is hereby expressly incorporated by reference. 
Once a complete tile has been captured, it can be decoded and the retrieved information 
used to perform a function. 

Unfortunately, prior art tiled code systems are somewhat limited in their use as 

graphical printing occlusions may obscure parts of a tile needed for decoding. What is 

needed is a code system that enables use with graphical occlusions. It is also desirable 

that the code system accommodate additional code elements such as address codes to 
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! provide more information in addition to that found in prior art tiled code systems. 

It is sometimes additionally desirable to occlude areas of the substrate with 
I graphical markings that may interfere with data glyph reading. For example, in a system 
jUmplementing a graphical user interface on a substrate, graphics, such as icons, may 

5 ;| occlude glyphs on the substrate. The user places an image capture device over an area of 

ij 

jithe substrate to select an icon. The image captured by the image capture device typically 
Ii includes regions where glyph codes are occluded. Conventional codes may not provide 
ij robust decoding because they are not designed to compensate for the occlusions. 

What is needed is a code system that allows for occluded areas of glyphs and still 
10 1 1 provides a robust decoding of the underlying glyphs captured by an image capture device 

I j having a limited window capture size. 

II SUMMARY OF THE INVENTION 

n 

|i Apparatus, methods, and articles of manufacture consistent with the present 

invention provide a tiled code system for embedded data on a substrate. The tiled code 
15 I system is embedded in machine-readable marks and facilitates robust decoding of 
machine-readable marks, such as glyphs, when areas on the substrate are occluded. 

Additional objects and advantages of the invention will be set forth in part in the 
description which follows, and in part will be clear from the description, or may be 
learned by practice of the invention. The objects and advantages of the invention will be 
20 iirealized and attained by means of the elements and combinations particularly pointed out 
in the appended claims. It is to be understood that both the foregoing general description 
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and the following detailed description are exemplary and explanatory only and are not 
restrictive of the invention, as claimed. 

BRIEF DESCRIPTION OF THE DRAWINGS 

The accompanying drawings, which are incorporated in and constitute a part of 
this specification, illustrate an embodiment of the invention and, together with the 
description, serve to explain the principles of the invention. 

Fig. 1 illustrates an overview of the properties of a glyph code pattern; 

Fig, 2 illustrates a glyph code pattem having repeating rectangular glyph tiles; 

Fig, 3 illustrates a glyph code pattem having repeating rectangular glyph tiles 
with periodic fixed marked occlusions; 

Fig. 4 illustrates a glyph code pattem having repeating rectangular glyph tiles 
with periodic variable marked occlusions; 

Fig. 5 illustrates a glyph code pattem having repeating rectangular glyph tiles 
with periodic occlusions with variable marking including overlay glyph codes; 

Fig. 6 illustrates a glyph code pattem having repeating rectangular gl)^h tiles 
with occlusions subperiodic in the X direction; 

Fig. 7 illustrates a glyph code pattem having repeating rectangular glyph tiles 
with occlusions subperiodic in the X and Y direction; 

Fig. 8 illustrates subperiodic strip occlusion rectangular glyph tiling and tile 
capture window as an application to text print GUI; 
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Fig. 9 shows embedded data in the form of an array of rectangular tiles in 
alternating shades of gray scale to illustrate one embodiment rectangular tile structures; 
Fig. 10 illustrates the embedded data of Fig. 9 without gray shading; 
Fig. 11 is a flowchart illustrating writing of a glyph code pattern having repeating 
5 I rectangular glyph tiles with occlusions; 

li 
ii 

ii Fig. 12 is a flowchart illustrating reading and decoding of a glyph code pattern 

II 

i I having repeating rectangular glyph tiles with occlusions; 

|| 

il Fig. 13 illustrates an address carpet code; 

i Fig. 14 shows the address carpet code of Fig. 13, filling the occlusion regions of 
10 I ; tiled code of columns of glyphs indicated in bold; 

j| Fig. 15 illustrates an embodiment using a tiled code and an occlusion code as part 

ii of a user selection process; and 

l! Fig. 16 shows an image capture system that may be used to select an icon and 

capture a corresponding portion of embedded data. 
15 1 DETAILED DESCRIPTION OF THE INVENTION 

Reference will now be made in detail to embodiments of the invention, examples 
ij of which are illustrated in the accompanying drawings. Methods, apparatus, and articles 
1 1 of manufacture disclosed herein consistent with the principles of the invention implement 

:ia code pattern tiled for a window capture having multiple occlusions of the glyph pattern 

\\ 

20 ij in which the code pattern is embedded. 

Ij Fig. 1 illustrates properties of glyph marks and codes embedded in the glyph 

1 1 marks. Glyph marks are typically implemented as a pattern on a substrate, such as glyph 
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marks 21 on substrate 24. Glyph marks 21 are not easily resolved by the unaided human 
eye. Thus, glyph marks 21 appear to the unaided eye to have a uniform gray scale 
appearance or texture. 

Enlarged area 23 shows an area of glyph marks 21 . Glyph marks 21 are typically 
comprised of elongated slash-like marks, such as glyph 22, and are typically distributed 
evenly widthwise and lengthwise on a lattice of glyph center points to form a rectangular 
pattern of glyphs. In one embodiment, glyphs are tilted backward or forward, 
representing the binary values of "0" or "1," respectively. For example, glyphs may be 
tilted at +45° or -45° with respect to the longitudinal dimension of substrate 24. Using 
these binary properties, the glyph marks can be used to create a pattern of glyph marks 
representing O's and Ts embodying a particular coding system. 

The glyph marks of enlarged area 23 can be read by an image capture device and 

decoded into O's and Ts by a decoding device. Decoding the glyphs into O's and I's 

creates a glyph code pattern 25. The O's and Ts of glyph code pattern 25 can be further 

decoded in accordance with the particular coding system used to create glyph pattern 21. 

Additional processing might be necessary to resolve ambiguities created by distorted or 

erased glyphs, hi one embodiment, glyph code pattern 21 comprises tiles of glyph 

marks. A tile is a shaped area, such as a rectangle, which can be repeated to cover the 

substrate without overlap. Consistent with the principles of the present invention, a tile 

is required to be used as the basis for a periodic tiling. This is analogous to the tiling of a 

wall with rectangular bricks. See, for example, U.S. Patent No. 6,000,621 to Hecht, et 

al, entitled Tilings of Mono-Code and Dual-Code Embedded Data Pattern Strips For 

-6- 
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Robust Asynchronous Capture, which teaches tiled codes, and is hereby expressly 
incorporated by reference. Tile shapes other than rectangular may also be used. 
;i In one embodiment, each tile comprises an identical pattern of glyph marks 

I I encoding identical information. For example, the tile information encoded by the glyph 

ii 

5 i| marks in each tile might comprise a label identifying the substrate, in addition to other 
1 1 information about the substrate, tiles, or glyph marks on the substrate. Thus, information 
1 can be derived by decoding the tiles. For example, in one embodiment the decoded 
;: information defines characteristics of the underlying substrate and the glyph marks on the 
i I substrate. 

10 jl Additionally, the codes in the tiles of glyph marks have particular properties that 

ji allow predetermined occlusions of the tiles without compromising decodability of the 

> : 

ii information encoded in a tile of glyph marks. An occlusion is an area of a tile that does 

'i 

i 

inot necessarily have the same coding scheme as the remainder of the tile. For example, 

I an area of a tile might be obUterated by an icon graphic printed over glyph marks of the 

i 
i 

15 I tile or some glyph lattice positions may be written with glyphs of another coding system, 

i 

i which may not necessarily be identical from tile to tile. 

I Each tile may have one or more predefined occlusion shapes in predefined 

respective locations in the tile. For example, the occlusions may be laid out with tiling 
; vectors that are an integer fraction, such as one-half or one-third of the repeating 

20 ;j contiguous tiles of glyph marks in one or two directions. 

;i 

il The occlusions may also have variable images within congruent occlusion tile 

Ii shapes. For example, the occlusions may have different marks and colors. The 
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occlusions may additionally comprise different visual indicia, such as graphics, text, 
glyphs, or a combination of different types of visual indicia. An occlusion that includes 
glyphs could be decoded to provide information. For example, the decoded information 
may provide information relevant to the particular occlusion image such as identification 
or type. 

Fig. 2 illustrates a glyph code pattern having repeating rectangular glyph tiles. 
Tiling vectors Tx and Ty define a rectangular glyph tile comprised of glyph codes CI 1 to 
C99. The glyph tile regularly repeats in the horizontal and vertical directions to form a 
tiling which is periodic in each direction. Glyph codes CI 1 to C99 of each tile comprise 
a glyph code pattern representing information, such as a label identifying the substrate on 
which the glyph tiles appear. 

Fig. 2 also illustrates a tile-shaped capture window, denoted by a broken line 
surrounding a rectangular area of the glyph code defined by comers C88, C87, C78 and 
C77. Capturing an image of an area encompassing at least the shape and size of a tile 
will include an instance of each common glyph mark of the tile. Because the captured 
image includes each common glyph mark of a tile, the tiled code can be reconstructed 
fi:*om the captured image. See, for example, U.S. Patent No. 6,000,621 to Hecht, et al, 
entitled Tilings of Mono-Code and Dual-Code Embedded Data Pattern Strips For Robust 
Asynchronous Capture, which teaches facilitating recovery of data through use of an 
appropriately-sized capture window, and is hereby expressly incorporated by reference. 

Fig. 3 illustrates a glyph code pattern having repeating rectangular glyph tiles 
with periodic fixed marking occlusions. The occlusions are periodic in that they appear 
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with regular frequency across the array of tiles. In Fig. 3, each tile has an occlusion ("M 
jj occlusion") covering a particular region within the tile. As shown in Fig. 3, each 
|! occlusion covers code positions C27, C28, C29, C37, C38, C39, C47, C48, and C49 in 
!; each tile. 

ji Fig. 4 illustrates a glyph code pattern having repeating rectangular glyph tiles 

i; with periodic variably-marked occlusions. As in Fig. 3, the occlusions are periodic in 

II 

' that they appear with regular frequency across the array of tiles. In the embodiment of 

il 
'I 

\\ 

llFig. 4, however, the occlusion in each tile ("Mxx occlusion") may have a unique 

; marking. For example, as shown in Fig. 4, each occlusion may be a unique graphic icon. 

; Using icons is particularly useful in implementing a graphical user interface. 

1 
I 

Fig. 5 illustrates a glyph code pattern having repeating rectangular glyph tiles 

with periodic occlusions that include glyph codes. Fig. 5 is similar to Fig. 4 in that each 

jitile has an occlusion covering particular glyph lattice positions within the tile. Each 

occlusion marking ("Mxx occlusion") may be unique. In Fig. 5, however, the occlusions 

include glyphs that change the visually apparent shape of the occlusion. These glyphs 

may be decodable to provide a code, such as a code identifying a particular occlusion. 

Occlusion glyphs may also be merely decorative. For example, occlusion Ml 2 in the 

upper middle tile includes glyph codes S29, S39, and S49, and occlusion M22 (not 

labeled in Fig. 5) in the lower middle tile includes glyph codes G27, G28, G29, G37, 

G38, G39, G47, G48, and G49. Thus, occlusions M12 and M22 include glyph codes on 

the same lattice as the tiled glyph codes, but have a code system S and G that may be 

different than tiled code system C. In another example, the glyph codes in the occlusion 
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area comprise address codes spanning multiple tiles and may be used to aid in 
reconstruction of the tiles from a captured image. 

Fig. 6 illustrates a glyph code pattern having repeating rectangular glyph tiles 
with subperiodic occlusions in the X direction. Each tile includes two occlusions, thus 
creating subperiodic occlusions in the X direction. These occlusions may include glyphs, 
as illustrated by occlusion Ml 4 and occlusion M24, 

Fig. 7 illustrates a glyph code pattern having repeating rectangular glyph tiles 
with subperiodic occlusions in the X and Y direction. Each tile includes four occlusions, 
thus creating subperiodic occlusions in the X and Y direction. Additionally, the 
occlusions may include glyphs, as illustrated by occlusion Ml 4. 

Fig. 8 illustrates a glyph code pattern having repeating rectangular glyph tiles 
forming strip occlusions. The strips are formed from contiguous occlusions in the X 
direction. In the embodiment shown in Fig. 8, text is marked on occlusions in the glyph 
pattern of repeating tiles. 

Fig. 9 shows embedded data in the form of an array of rectangular tiles in 
alternating shades of gray scale to illustrate one embodiment of rectangular tile 
structures. The center of each tile as shown in Fig. 9 may have an occlusion. In Fig. 9, 
the occlusion of the tile at the center is a document icon. The occlusion may also 
comprise other graphics, text or glyph codes. When glyphs fill in the occluded area, the 
occlusion glyphs can be visually indistinguishable from the tiled code. 

Fig. 10 illustrates the embedded data of Fig. 9 without gray shading. The 

occlusions filled in with glyphs are visually indistinguishable from the tile glyphs. 

- 10- 
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Fig, 1 1 is a flowchart illustrating writing of a glyph code pattern having repeating 
rectangular glyph tiles with occlusions. A bitmap image of tiles with occlusions is 
created (step 224), and the bitmap image is printed on a substrate (step 226). In another 
embodiment, the tiles are printed on a substrate and the occlusions are printed over the 
5 I i tiles in a second printing operation. In yet another embodiment, all glyphs are printed 
1 1 together on a substrate and non-glyph occlusion graphics are printed over or under the 
glyphs in a second printing step. This last embodiment facilitates better alignment of all 

lithe glyphs, 

\- 

i; Fig. 12 is a flowchart illustrating the process performed by a processor when 

10 ij reading and decoding a glyph code pattern having glyph tiles with occlusions. In one 

!| 

[j embodiment, the process is performed by a glyph reading device coupled to a processor 

!: 

liprogrammed to perform the steps depicted in the flowchart of Fig. 12. The process could 
i I also be performed by special purpose hardware or a combination of hardware and 
I software. 

15 ii A reading device is used to capture an image of an area of glyph marks from a 

r 

I substrate (step 124). The glyphs in the captured image are converted into a matrix of O's 

i 
j 

Wd Vs (step 126). The matrix is decoded to identify code portions of the tile codes and 

i 

t their logical addresses (step 127). Based on the code portions and their logical addresses, 
khe tiling vectors are determined (step 128), from which the tile is logically reconstructed 
20 ||(step 129). The tile is then decoded, and the occlusion in the tile may be processed. The 
occlusion is decoded as well if the occlusion includes decodable information, such as 
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check box which may be decoded using existing mark recognition methods. Using the 
decoded tiled information and the information from the decoded occlusion, if any, 
processing continues by performing an operation associated with decoded tile 
information and the decoded occlusion information (step 132). 

Fig. 13 illustrates an address carpet code. The code is shown and described in 
U.S. Patent AppUcation No. 09/455,304, entitled "Method and Apparatus for Decoding 
Angular Orientation of Lattice Codes," which is hereby expressly incorporated by 
reference. 

Fig. 14 shows the address carpet code of Fig. 13 filling the occlusion regions of 
tiled code in columns of glyphs indicated in bold. The tiled code period in the X 
direction includes four columns spanning tiling vector Tl. The address carpet codes can 
be used to establish the logical order or address of the tiled code pattern. 

Capture window A illustrates a capture area of sufficient extent so as to 
encompass an area from which the underlying address code and tiled code pattern can be 
decoded. In the embodiment illustrated in Fig. 14, the area encompasses at least a length 
Tl in the x tiling direction and a height in the y direction so that confident values of n 
consecutive bits in each of address codes u, v, and tiled code d can be decoded correctly. 
The precise location of the capture window may vary. For example, capture window B 
illustrates a capture area having the same shape and area as capture window A, but 
shifted in the x and y directions relative to capture window A. 

In another embodiment of the coding system of Fig. 14, graphics are included on 

the substrate with the tiled pattern and address carpet codes. The graphics may be 

- 12- 
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comprised of glyphtones, or may partially obscure the tiled pattern and/or the address 
carpet codes. The graphic must be of such a character so as not to obscure the tiled 
pattern or address carpet codes to the point where they cannot be decoded. For example, 
if the graphic obscured a sufficiently large number of glyphs which define the tiled 
pattern, the pattern could not be decoded from a captured image. 

Fig. 15 illustrates an embodiment using a tiled code and a selection code as part 
of a user selection process. A context code is decoded from the tiled code pattern, and an 
address pattern located within occlusion regions provides a selection code by spatially 
locating the selection. Additional selection codes may be provided by angular 
orientation of the capture and user control signals via buttons etc. The context code and 
I selection code are provided to syntax processing 404. Syntax processing 404 determines 

j I whether an action should be taken or whether additional selections need to be made, as is 

jl 

I i conventional in user selection processing. 

I This two-level coding system can be used in several ways, such as to implement a 

j 

; graphical user interface. To use this user interface, a user places an image capture device 
jon or near a selection, such as a graphic which may form an occlusion. As an example, 
the user may place the image capture device in the selection's "hot zone" as described in 
icommonly assigned U.S. Application Serial No. 09/144,150 entitled METHODS AND 
APPARATUS FOR CAMERA PEN (Attorney Docket No. 07447.0003-00000), which 
teaches that a hot zone is an area on or near the visual indicia and is equivalent to 
selecting the visual indicia. U.S. Application Serial No. 09/144,150 is hereby expressly 
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allow the tile pattern to be decoded. The image is then decoded to determine the context 
code from the tile pattern and a selection code associated with the position of selection. 
This allows tiled codes to be used in a system for capturing an image, decoding the 
image to determine one or more particular codes from the image, and performing 
operations based on the one or more particular codes, as described in U.S. Patent 
Application Ser. No. 09/223,882, filed December 31, 1998, and entitled MULTI-LEVEL 
SELECTION METHODS AND APPARATUS USING CONTEXT IDENTIFICATION 
FOR EMBEDDED DATA GRAPHICAL USER INTERFACES, which is hereby 
expressly incorporated by reference. 

Fig. 16 is a block diagram of an image capture and processing system consistent 
with the invention that may be used to: capture a user-selected portion of a substrate 432 
comprising glyph marks 434 (shown generally as light gray print) and occlusions 436 
(shown generally as dark gray print); decode the embedded data markings in the captured 
portion; and perform ftirther processing on the decoded information, as described herein. 
In one embodiment, computer system 412 is a general purpose computer system, such as 
a conventional personal computer or laptop computer, that includes main memory 416, 
read only memory (ROM) 418, storage device 420, processor 422, and communication 
interface 424, all interconnected by bus 426. Bus 426 also coxmects to display 430, 
cursor control 414, and frame capture 428. 

An image capture device, which in this case is a camera pen 410 or camera mouse 

431, is connected to frame capture 428, Either camera pen 410 or camera mouse 431 

may be used, but camera pen 410 will be used for purposes of discussion. Camera pen 

- 14- 
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410 captures an image from substrate 432 and transfers the captured image to frame 
capture 428. The user makes a selection by placing camera pen 410 on or near visual 
indicia on glyph marks 432, and pressing one or more buttons on the device. For 
example, pressing button 414 causes camera pen 410 to capture the portion of the 
5 1 1 substrate 432 under the tip of camera pen 410, and transmit the image to computer 412, 
<! via frame capture 428, for analysis. The depression of one or more buttons can be used 

I for additional signaling, as in a double cHck, hold down. 
As shown in Fig. 16, substrate 432 is comprised of embedded data, such as glyph 

marks 434 and occlusions 436. Frame capture 428 collects the captured data and 
10 ;! separates it into individual frames. These results, together with signals from cursor 
|i control 414 are transferred to processor 422 for further processing. In one embodiment, 
i|Camera pen 410 also transmits button depression signals to frame capture 428 and cursor 
i control 414. The signals cause frame capture 428, cursor control 414, and processor 422 
lito process the images and button depression signals, 

15 11 Processor 422 processes the results from cursor control 414 and the captured 

h 

I I frame image from frame capture 428 as previously discussed in respect to Fig. 12. In one 
embodiment, processor 422 computes a context code, a location code, and a rotation 
code from the data. The context code defines a particular context of substrate 432, such 
as a substrate page number. The location code defines the location on substrate 432 from 

20 i location where the captured image was taken. Using the context code location code and 
j: rotation code (optionally), processor 422 accesses information related to the context code 
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code indicates location coordinates x=97 and y=92, and rotation = 43"*, then processor 
422 would retrieve information corresponding to that specific location and rotation from 
substrate 432. 

In one embodiment^ the retrieved information includes two types of information: 
a bit map image representation of substrate page iv, and icon information defining the 
locations and meaning of icons on substrate page iv. In operation, a user selects an icon 
representing a system object on substrate 432 via an image capture device. In response, a 
system attached to the computer system of Fig. 16 (not shown) can use the retrieved 
meaning of the icon to perform functions corresponding to the icon, as a conventional 
system would in response to user selection of an icon on a graphical user interface in a 
conventional display. Such a system is shown and described in previously referenced 
U.S. Patent Apphcation Serial No. 09/223,882 entitled "MULTI-LEVEL SELECTION 
METHODS AND APPARATUS USING CONTEXT IDENTIFICATION FOR 
EMBEDDED DATA GRAPHICAL USER INTERFACES." 

In one embodiment, main memory 416 is a random access memory (RAM) or a 
dynamic storage device that stores instructions executed by processor 422. Main 
memory 416 may also store information used in executing instructions. ROM 418 is 
used for storing static information and instructions used by processor 422. Storage 
device 420, such as a magnetic or optical disk, also stores instructions and data used in 
the operation of computer system 412. 
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Display 430 may be a CRT or other type of display device. Cursor control 414 
controls cursor movement on display 430. Cursor control 414 may accept signals from 
any type of input device such as a trackball, or cursor direction keys. 

The system shown in Fig. 16 can be used to capture and decode the occluded 
embedded data described herein. The system may also implement the two-level syntax 
processing discussed with respect to Fig. 15. The apparatus and methods described 
herein may be implemented by computer system 412 using hardware, software, or a 
1 1 combination of hardware and software. For example, the apparatus and methods 

i| described herein may be implemented as a program in any one or more of main memory 

i| 

10 :i416, ROM 418, or storage device 420. In one embodiment, processor 422 executes 
ii programs which analyze captured portions of occluded embedded data to determine 
li address information encoded in the embedded data. 

ii 

; Such programs may be read into main memory 416 from another computer 

readable medium, such as storage device 420. Execution of sequences of instructions 
15 ! contained in main memory 416 causes processor 422 to perform the process steps any 
other physical medium with patterns of holes, a RAM, a PROM, an EPROM, a 
FLASH-EPROM, any other memory chip or cartridge, a carrier wave as described 
hereinafter, or any other medium from which a computer can read and use. 

Various forms of computer readable media may be involved in carrying one or 
20 more sequences of instructions to processor 422 for execution. For example, the 
instructions may initially be carried on a magnetic disk or a remote computer. The 
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instructions over a telephone line using a modem. A modem local to computer system 
412 can receive the data on the telephone line and use an infrared transmitter to convert 
the data to an infrared signal. An infrared detector coupled to appropriate circuitry can 
receive the data carried in the infrared signal and place the data on bus 426. Bus 426 
carries the data to main memory 416, from which processor 422 retrieves and executes 
the instructions. The instructions received by main memory 416 may optionally be 
stored on storage device 420 either before or after execution by processor 422. 

Computer system 412 also includes a communication interface 424 coupled to 
bus 426. Communication interface 424 provides two way communications to other 
systems. For example, communication interface 424 may be an integrated services 
digital network (ISDN) card or a modem to provide a data communication connection to 
a corresponding type of telephone line. Communication may also be, for example, a 
local area network (LAN) card to provide communication to a LAN. Communication 
interface 424 may also be a wireless card for implementing wireless communication 
between computer system 412 and wireless systems. In any such implementation, 
communication interface 424 sends and receives electrical, electromagnetic or optical 
signals that carry data streams representing various types of information. 

The link between communication interface 424 and external devices and systems 

typically provides data communication through one or more networks or other devices. 

For example, the link may provide a connection to a local network (not shown) to a host 

computer or to data equipment operated by an Internet Service Provider (ISP). An ISP 

provides data communication services through the world wide packet data 
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i communications network now commonly referred to as the Internet. Local networks and 

1 
I 

lithe Internet both use electrical, electromagnetic or optical signals that carry digital data 

Ij 

!; streams. The signals through the various networks and the signals between the networks 

j ^ 

;i and communication interface 424, which carry the digital data to and from computer 

ji 

5 li system 412, are exemplary forms of carrier waves transporting the information. 

li Computer system 412 can send messages and receive data, including program 

i I code, through the network(s) via the link between communication interface 424 and the 

li 
li 

i: external systems and devices. In the Internet, for example, a server might transmit a 

i! 

i ' requested code for an application program through the Internet, an ISP, a local network, 
10 ;j and communication interface 424. 

l' Program code received over the network may be executed by processor 422 as it 

i-is received, and/or stored in memory, such as in storage device 420, for later execution. 
Min this manner, computer system 412 may obtain apphcation code in the form of a carrier 
;iwave. 

15 ji The term "computer-readable medium" as used herein refers to any medium that 

I participates in providing instructions to processor 422 for execution. Such a medium 

I 

may take many forms, including but not hmited to, non- volatile memory media, volatile 
i memory media, and transmission media. Non-volatile memory media includes, for 
! example, optical or magnetic disks, such as storage device 420. Volatile memory media 

20 I i includes RAM, such as main memory 416. Transmission media includes coaxial cables, 

ij 

j; copper wire and fiber optics, including the wires that comprise bus 426. Transmission 

i| 
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media can also take the form of acoustic or light waves, such as those generated during 
radio wave and infrared data communications. 

Common forms of computer-readable media include, for example, a floppy disk, 

I' a flexible disk, hard disk, magnetic tape, or any other magnetic storage medium, a CD- 

11 

li 

5 jlROM, any other optical medium, punch cards, paper tape, any other physical medium 

]\ 

I j with patterns of holes, a RAM, a PROM, an EPROM, a FLASH-EPROM, any other 

|l 

il 

I I memory chip or cartridge, a carrier wave as described hereinafter, or any other medium 
I from which a computer can read and use. 

!i 

|: Various forms of computer readable media may be involved in carrying one or 

il 

10 jimore sequences of instructions to processor 422 for execution. For example, the 
instructions may initially be carried on a magnetic disk or a remote computer. The 
remote computer can load the instructions into its dynamic memory and send the 
instructions over a telephone line using a modem. A modem local to computer system 
412 can receive the data on the telephone line and use an infrared transmitter to convert 
15 the data to an infrared signal. An infrared detector coupled to appropriate circuitry can 
receive the data carried in the infrared signal and place the data on bus 426. Bus 426 
carries the data to main memory 416, from which processor 422 retrieves and executes 
the instructions. The instructions received by main memory 416 may optionally be 
stored on storage device 420 either before or after execution by processor 422. 
20 i Computer system 412 also includes a communication interface 424 coupled to 

I; 

iibus 426. Communication interface 424 provides two way communications to other 
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digital network (ISDN) card or a modem to provide a data communication connection to 
a corresponding type of telephone line. Communication may also be, for example, a 
local area network (LAN) card to provide communication to a LAN. Communication 
interface 424 may also be a wireless card for implementing wireless communication 
between computer system 412 and wireless systems. In any such implementation, 
communication interface 424 sends and receives electrical, electromagnetic or optical 
signals that carry data streams representing various types of information. 

The link between communication interface 424 and external devices and systems 
typically provides data communication through one or more networks or other devices. 
For example, the link may provide a connection to a local network (not shown) to a host 
computer or to data equipment operated by an Internet Service Provider (ISP). An ISP 
provides data communication services through the world wide packet data 
communications network now commonly referred to as the Internet. Local networks and 
the Internet both use electrical, electromagnetic or optical signals that carry digital data 
streams. The signals through the various networks and the signals between the networks 
and communication interface 424, which carry the digital data to and from computer 
system 412, are exemplary forms of carrier waves transporting the information. 

Computer system 412 can send messages and receive data, including program 
code, through the network(s) via the link between communication interface 424 and the 
external systems and devices. In the Internet, for example, a server might transmit a 
requested code for an application program through the Internet, an ISP, a local network, 
and communication interface 424. 
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Program code received over the network may be executed by processor 422 as it 
is received, and/or stored in memory, such as in storage device 420, for later execution. 
I In this manner, computer system 412 may obtain application code in the form of a carrier 

I wave. 

\\ 

5 I! Other embodiments of the invention will be apparent to those skilled in the art 

il 

II from consideration of the specification and practice of the disclosed embodiments. The 

11 

II specification and examples are exemplary only, and the true scope and spirit of the 

li 
it 

1 1 invention is defined by the following claims and their equivalents. 

'I 
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